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Background of the Invention 
This application claims the benefit of U.S. Provisional Application No. 
60/257,210, of Osher et al., filed December 20, 2000, entitled "Geometrically Accurate 
4, • Compression and Decompression", which is incorporated herein by reference. 

5 The present invention relates to a system for compressing and reconstructing 

(decompressing) signals, including signals representing physical data such as terrain. Such 
signals may be computer-constructed data, empirically derived images or signals, or in 
general any information or data representing actual or simulated phenomena. 
*•)*•*"••-•* After compression of data representing a terrain, digital terrain elevation (or " — 
10 images, indeed any graph) data' ("DTED"), a common problem is accurate reconstruction 
of terrain features, such as the slope. Given digitized data representing terrain elevation, 
or indeed any graph in two or more dimensions at a data point (x,y) (or the multiple : " 




■- 



dimension extension at a data point (x b . . .jj), it is highly useful to be able to con^ress^^^^ 
• and decompress the data in such a way that terrain - or, more generally, graph or image 
15 features - are accurately reconstructed. 

Conventional systems in current use compress the data, store or transmit it as 
needed, and at a later point reconstruct the data from the compressed-data files. This can 
lead to large errors in derived quantities obtained from the reconstructed data, in particular 
when the gradient of the reconstructed data is taken. 
20 The gradient of the original data is often of considerable interest. In the case of 

DTED, it may be important for aircraft to be aware of the precise terrain slopes, and the 
errors introduced by determining gradients from reconstructed data may be too great to be 
of practical use for many applications. 

Especially for lossy compression techniques, a reconstructed image generally does 
25 not have the same values for the norm of the gradient that the original image had. In fact, 
errors in the gradient are often quite large for higher compression ratios. These errors are 
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quite significant since the accuracy of the terrain slope is crucial in many areas, e.g. 
landing of aircraft in navigation exercises. 

Accordingly, a system is needed that can compress and reconstruct 
multidimensional data, such as terrain data or other signals, with an increased accuracy in 
the reconstructed information, and in particular in the gradients that are determined from 
the reconstructed data, and the norms of those gradients. 



are implemented in a processor-based system. A method according to the invention 
provides an accurately compressed and reconstructed signal, and in particular accurately 
reconstructed gradients of the original signal, by applying compression procedures to the 
gradient of the original signal. An alternative embodiment further involves the process of 
generating a second gradient of the original signal, and compressing that second gradient, 
which upon decompression provides an accurate reconstruction of the second gradient of 
the original signal. The methods of the invention are suitable for compressing, storing, 
transmitting and reconstructing both simulated and empirical data representing terrain and 
other physical or hypothetical signals or surfaces, in one or multiple dimensions. 

Brief Description of the Drawings 
Figure 1 is a block showing a processor-based system suitable for an 

implementation of the present invention. 

Figure 2 is a representation of a signal that can be compressed and reconstructed 

according to the present invention. 

Figure 3 is a representation of a gradient of the signal of Figure 2. 



Summary of the Invention 
An apparatus and method according to one embodiment of the present invention 
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Figure 4 is a representation of another signal that can be compressed and 
reconstructed according to the present invention. 

Figure 5 is a representation of a gradient of the signal of Figure 4. 

Figure 6 is a representation of a gradient of the signal of Figure 5. 

Figures 7-8 are flow charts representing methods implementing aspects of the 
present invention. 



Description of the Preferred Embodiments 

Figure 1 illustrates a processor-based system 100, such as a workstation or a 
server, in connection with the present invention may be implemented. The system 100 is 
coupled to a display 1 1 0 and one or more user interface devices 120 (such as a mouse, 
keyboard, track ball, etc.), and operates under control of at least one microprocessor 130 
(though it may be a multiprocessor system). : ; v ; 

The processor 130 is connected to a local device control circuitry 140, which 
includes circuitry that controls data and command exchanges with local devices such as 
the display 1 10 via an accelerated graphics processor (AGP) 150 and memory 160, which 
may in a typical system will include multiple DIMMs (dual in-line memory modules) or 
other suitable memory modules or media. 

The local device control circuitry 140 is connected to a peripheral device control 
circuit 170 via a bus such as PCI bus 180. The system 100 additionally is connected to 
local internal and/or external storage 190. 

Input/output (I/O) channels 200 are connected to or in communication with the 
system 100, and may include conventional network connections, wireless 
communications devices, and/or other conventional apparatus for exchanging data with the 
system 100. In addition, transmitters, receivers or in general transceivers 210 may be 
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connected to or in communication with the system 100, which are suitable for remote or / 
isolated operations include weather stations or other telemetry stations, on aircraft, etc. 

The compression and decompression operations of the present invention are in 
one embodiment carried out under the control of program modules stored in the memory* 
160 and executing on the processor 130. These operations may be implemented in and/or 
executed by software, hardware (e.g. in configured field gate arrays, custom logic, etc.), 
firmware or some combination thereof. In this application, the term "logic** will be used 
to refer to any such appropriate combination of software, hardware, firmware or other 
manner of implementing the invention. > 

The image, terrain, or other data relating to the invention will typically take the 
form of data files stored in memory or in some storage medium, which can be read, 
modified, stored, output, displayed and printed by the computer system, either under 
automatic (or program) control or under the direction of a user. % 

Compression and Reconstruction of Gradient Data 

The system of the invention is applicable to many types of compression 
procedures presently in use, with improved accuracy of the reconstructed signals, and in 
particular of their gradients (or slopes) and corresponding norms of those gradients. An 
example of one appropriate compression procedure is a histogram equalization procedure, 
as described, for instance, in Sapiro, G. and Caselles, V., "Histogram Modification via 
Differential Equations", Journal of Differential Equations, Vol. 135, No. 2, pp. 238-268 
(1997), which is incorporated herein by reference. Generally, appropriate compression 
procedures include those that are exact for constant signals, but are lossy in the general 
case (such as JPEG or histogram equalization). 

Thus, the inventive methods may be applied to signals processed according to any 
compression procedures. In addition, the inventive methods may be applied to signals 
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representing data of many dimensions. However, for the sake of the following discussion 
a two-dimensional signal will be taken as an example. 

The normal vector to the signal or graph representing a surface or terrain is given 



Mm 



by: 



It follows that the steepness (or slope) of the terrain surface is determined by the gradient 
of that signal, namely: 

|Vu|-^ 2 +w/. 



A method according to the present invention compresses the gradient f7«|, rather 
than the signal w itself. The basic framework of such a method is carry out the following ^V^ ; ^^ 
operations: 



Operation #1: Compute ^uj either aiudytically or numerically. (It may be done 
15 analytically for simulated data, and numerically for empirical data, or even analytically for 
empirical data that has been approximated by mathematical representations.) 
Operation #2: Use any suitable compression technique to compress and store (or 

transmit) |Vu| as Jvuj. 

Operation #3: Recover a reconstructed signal v by solving the equation: 
20 Equation A: |Vv| - Vw . 

In particular, this can be solved using fast numerical level set based procedures for solving 
the Eikonal equation |Vv| - Vh|. 

Figure 7 is a flow chart according to this series of operations. 
An Eikonal equation is one of the form 
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^ + vJ-C(x f y) for C(x,y)>0. 
This gives a generalized distance to a set. If C ■ 1, then the distance is a real distance./ r : 
Examples of this may include: (a) distance to the origin of a coordinate system, and (b) 
distance to a set defined by the equation x=0. 
(a) Distance to the origin. 

If v - t]x 2 + y 2 , the distance is to the origin x=y=0, with: 
v mm x ♦ v » , ^ ; and 

2 2 * 2 + y 2 t 

V x+ V y- 2 2 " 1 

(ft) Distance to a setx=0. 

If v - (jc|, the distance represents a distance to the set x=0, with: 
v x -l ifjc>0; 

--1 if *<0;and 
v y -0; 

and thus v] + v 2 y - 1. At least a few values of v - u at a few data points are input, 

including certain boundary points and points of extrema of u. 

A system according to the present invention can take advantage of fast methods to 
compute the unique viscosity solution to this Hamilton- Jacobi nonlinear partial 
differential equation, i.e. the Eikonal Equation A above. The viscosity solution is used 

because Ivul represents — - — in the Eikonal Equation. Thus, we can view 
I i velocity 

Equation A above as finding the distance v in that variable metric. 
Operation #3 above involves the solution of 

|Vv|-/(*oO, 
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where /(*,y) - [vw| is the compressed quantity. As mentioned above, this may be a >.•.• 
numerical or an analytical solution. x Jrf 




It has been proven that there exists a unique viscosity solution to this equation, 
given the values of u at appropriate data points. See Rouy, E. and Tourin, A., A viscosity 
solutions approach to shape from shading, SLAM Journal of Numerical Analysis, Vol. 29, 
No. 3, pp. 867-884 (1992). There are fast Dijkstra-like algorithms and/or sweeping 
algorithms that are designed for this purpose. On Dijkstra-like algorithms, see: J. N. 
Tsitsiklis, "Efficient Algorithms for Globally Optimal Trajectories", IEEE Transactions 
on Automatic Control, Vol. 40, No. 9, September 1995, pp. 1528-1538, which is 
10 incorporated herein by reference. 

To solve the Eikonal equation in any number of independent variables (x, y, z, . . .) 
on a distance grid with n points and values of u assigned at isolated points, there is a . , 
shortest-path type of algorithm given by Tsitsiklis, which runs in optimal time v . ^ yf^^-Mf^k 
0(n log n) , with n being the number of pixels. Dijkstra approach is a classical algorithm 
15 which computes the "taxicab" distance metric, i.e. which solves: 

max(|« jr |,|u y |)-C(^y) 

in this optimal time. Tsitsiklis generalized it to the true geodesic distance (as the crow 
flies). The classical algorithm and its generalization update each grid point once in 
increasing order of distance, and may use an CKlogn) heapsort search. 

20 Fast sweeping algorithms solve the same algebraic expression as the Dijkstra-like 

algorithms on the grid at each point - however, not in increasing order of distance, but 
rather in an iterative fashion, updating points as often as needed until convergence within 
a predetermined tolerance. Fast sweeping methods can involve simplified programming 
and can be faster, e.g. if C(x,y) ■ 1 and a left-right, up-down procedure is used. See, e.g., 



V/\-*r' ' 
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M. Boue and P. Dupuis, Markov chain approximations for deterministic control 
problems with affine dynamics and quadratic cost in the control, SLAM J. Numcfc^; '' r '' sf j 
Analysis, Vol. 36, No. 3, pp. 667— «95 (1999). v J 

Input used for these fast solution techniques (which can be referred to as "fast \ 
solvers") are the numerical values of f(x,y) and the values of u at grid points where 
\7u\ is less than some very small tolerance (i.e. where u might be an extremum). 

This present invention is thus useful in combination with any compression 
routine. . 

One might consider the approach of compressing the vector Vu - (u x ,u y ) to get 
Vu - (uj,uj), and then recover u . There are two conditions that must be considered to 
avoid inaccuracies in the reconstruction of die gradient: 

(i) There is a need for compatibility, i.e. ■ v!^^ 

0O,-ty),, , /V 

at least approximately, and this is generally false for the recovered w, using this simplified 
procedure. 

(ii) Reconstructing u from one compressed derivative, e.g. solving numerically 
- u x can lead to large errors in the resulting v y . 

Reconstruction of the signal from the decompressed gradient is effectively an 
integration process, which can be carried out numerically or can be carried out analytically 
for a function derived from or representing the decompressed signal (within some 
predetermined level of accuracy). Such integration can be carried out for each level of 
gradient operation (e.g. for second gradients -see Alternative Method I, below). 
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Other implementations of the basic method for solving (Vw| - can be enhanced 



^•^^P^^^Sfrih/several ways. Figure 8 is a flow chart illustrating an Alternative Method I/as follows 



S^R d ^ 5 i Alternative Method I 




(1) Compute numerically 

(2) Confute numerically ^|Va|. 

(3) Compress and store f?JV«{, obtaining Jy|y w |- 

(4) Recover v using fast a Eikonal solver Jades. First solve for w in 



Then solve for v in 



Vw|-|v|Vm||' 



|Vv|->v. 




Wherever numerical computation or data generation is called for herein, it should 
be understood that under appropriate circumstances an analytical solution may be 
generated, and vice- versa. In either case, a predetermined level of accuracy may be used a 
13 controlling factor, e.g. for the compression, gradient, integration and/or reconstruction 
operations. 



The extra data storage that would be used for this algorithm is the storage of v - u 
and | Vv | - | Vu | at extrema, i.e. those points for which | Vu | and ft |Vm||, respectively, 
20 have values below a small predefined tolerance. 
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This method can be generated recursively to N Eikonal solvers. The extra storage % l; 
is minimal, but the decompression step would be approximately N times slower. . . 




Alternative Method II 

(1) Solve 

(2) Compress - w)\ t and obtain Jv(« - 

(3) Solve |Vz|«|v(^^. 

In steps (1) and (3), use the values of u and u - w, respectively, at their approximate 
extrema, as usual. 

(4) Then obtain v, the reconstruction of u, via v - w + z. 

This method adds a correction to the basic method by compressing and reconstructing 'W^ff- 
errors in |Vm|. 



Rssemmg Curvature 

Additionally, other geometric features of the terrain, for example mean curvature 
of the surface, can be recovered from compressed data in a similar manner. Following is a 
procedure for recovering curvature. 
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10 



15 



20 



For a surface defined by 
z-u(x,y), 

its mean curvature is: 




See S. Osher and J. A. Sethian, "Fronts Propagating with Curvature-Dependent Speed: : V 
Algorithms Based on Hamilton- Jacobi Formulations", Osher, S., and Sethian, J.A., ^; i; 5 ^j; 
Journal of Computational Physics, Vol. 79, pp. 12-49 (1988), which is incorporated ^ 
herein by reference. ^ ^ : v ' V :*f v 

This involves first and second partial derivatives of u. Thus, in order to recover; { 
curvature from compressed data, Alternative Method I above can be used, with 
This allows the recovery of a signal v whose second and first derivatives are accurate 

approximations to those of u. Then a numerical implementation for the expression 4 > \ " - ' 

.... ;v:*y^'>v 
defining k above may be used, where v replaces u. ; 7 

Higher derivatives of curvature - in fact all geometric features - can be recovered 
in an analogous fashion, which will be clear from the foregoing to those skilled in the art 
For instance, instead of using the Eikonal equation, one can take any elliptic differential 
operator of second or higher order, for example the Laplacian 



and solve numerically 



-4(v) - + Uyy, 



^(v)-^(v) 



for v , where appropriate boundary conditions are imposed. Then geometric features can 
be recovered as above. 
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The inventive methods provide improved compression ratios for DTED, images 
or graphs which have large flat regions where |Va| or any desired feature will be zero/ 
hence easy to compress. Thus the inventive methods are highly accurate in these 
situations in retrieving the data, as well as the desired feature or features. v ; y 

Pseudocode Appropriate for Method Involvinz Compressing Normals to Gradients 

The following pseudocode relates to compressing a quantity, e.g. the norm of the 
gradient, from an original set of data, and recovering the original data from the compressed 
quantity. V 

// Read in the original file and store it as quantity u[i][j] 

// Compute the derived quantity, e.g. norm of grad u[i]£j] 

II Store the norm as a separate quantity v[i][j] 

%% Compression routines are completely up to the users' preference. :"- ^ 
%% Possible compression techniques include JPEG-LS, JPEG, LSS (LevelSet 
% % Systems of Los Angeles, California) . 

%% LSS ' technique can used with lossy compression techniques, wherein 
%% there are errors between the original and restored image. 

// Compress the original file 

// Compress the normal vectors file 

// Decompress the compressed original file 

// Decompress the compressed normal vectors file 

// Read in the compressed/ decompressed original file - store it as 
quantity uc[i][j] 
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II Read in the conpreased/decompressed normal vectors file - store it 
as quantity vc [ i ] [ j 1 



// Reconstruct an approximation to the original image u(±]][j), from 
the compressed/decompressed quantity vc[i][j]. This reconstruction is 
based upon numerically solving the partial differential equations 




| grad w| - vc[ij[ j] 



for w[i][ j] 



10 



v-^A*^ ****** ■ 



// As an initial gueas, you may used w - uc[i][j], or set w » stored '4 
values of u[i][j] at isolated extrema. *%>?^A0 



From this procedure, it can result that w[i][j] will be a better approximation to 
15 u[i][j] than ucfllj], because the relevant quantity v[i][j] will be better approximated byJi00i0?- 
\ w[i][j] than it wiU be by uc[i][j]. • ^^0^^^ 

The Level Set Systems approach mentioned above can be found in'applicant*^-^^^^^ 
copending patent application, "Method and Apparatus for Feature-Based Quantization 
and Compression of Data", Serial No. 09/737,834 filed December 14, 2000, which is 
20 incorporated herein by reference. 



Examples of Application of Methods According to the Invention 

Examples 1 and 2 below will be discussed in connection with Figures 2-6. 
Figure 2 illustrates a one-dimensional signal that may be divided into N pixels in 
25 this manner, where N = 10 for the sake of the example. Thus, in Figures 2-6, the x- 

coordinates indicating the N pixels are labeled j=l, 2, . . ., 10, and the signal may be 

expressed as: 
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15 



In general in the present description, an original signal will be denoted as u and its - 
components as Uj. A reconstructed signal (i.e. data that has been regenerated from 
compressed data) will be denoted as v (and its components as vj) or w (and its * 
components as vv y ), as will be seen below. In addition, a compressed signal or data wiU 4 be&* . 



denoted by a double bar over the compressed quantity; so u would indicate the 
compressed form of the data or signal u, and similarly with any other quantities or 
expressions. 

This simple signal is sufficient to illustrate the operation of the present invention, 
and it is straightforward to generalize the procedures of the invention to signals of two or 
more dimensions, and to real- world settings of three-dimensional phenomena. 

The quantity (V«j (rather than u) is compressed according to the present 
invention, and can be computed by standard finite difference methods. Thus, 




wm 



ft j - * N for j > 2; and 



For simplicity, in these examples, we may take uj > Uj.j for all j, so we can remove 
the absolute value notation shown above. 



Example l 

Figure 2 shows an example of a one-dimensional linear signal u % expressible as 
20 vector of data u - {u } } , where: 

Uj-j/N 0-1, 2 N). 

Then fru\. - 1 for all j, as shown in Figure 3. Note that |Vu| is a constant, independent 

of j. Thus, the compressed value of (Vu| is the same as the uncompressed value, as in 
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Figure 3. In this example, then, there is no error in the compressed and uncompressed 
values of |Vw|, nor is there any error in u or the reconstructed v. ;:; : ^^;v^ ^^^ 

In general, in this description the variable u will be used to refer to the original 




signal or data, and the variables v and w will be used to indicate the data after ■ - 

reconstruction (after of the first or second gradient or derivative, as will be discussed r 

■ •■ • ■ ■' •+ 

below). .. - :-/^#fi|£ 

Generally, lossy compression procedures will result in errors in signals u that do v ; v 
not comprise constant values, so earlier methods (which compress the signals u, and not " ^ 
the gradient of w as in the present invention) will lead to larger errors in the gradient of Ae';-- 5 :'^^^^ 
reconstructed signal, i.e. (Vu|, than in the present system. As mentioned above, the t 
methods of the invention involving compression of gradient values instead of the original v' -v^ ; 



signal data are applicable in one dimension or in multiple dimensions. - ^^^^^^ ^ ^^ 

- ■ ' ' • y-d \Tt&^%*kf 

Figure 4 shows an example one-dimensional signal, expressible as: 

«i-^Jr O-1.2,. ...N) 

Thus, for this signal (Vw| y » as shown in Figure 5. (Note that the values of (Vu| ; in 

Example 2 are the same as the values of uj in Example 1 , which follows since the above 
function for uj in Example 2 was obtained by integrating the value uj = j/N from 
Example 1.) 

If the approach of compressing the derivative (or gradient) of the function is used, 
rather than compressing the function itself, then we compute |V|Vu|, and obtain: 
|V|Vu^ - 1 for all j (as shown in Figure 6). 
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The compression of this is error-free (for this example), and hence the errors inltie 
^ ;1> V;-, . , reconstructed w (which approximates |Vu|) and v (which approximates w/are alw j^o, 
^^•^•-•-•-v.Vg ^ em)r ^ e curvature approximating the curvature of z - u(x). Here; ^ 




(l+<) 

5 since there is no dependence on y. Thus, the method of Figure 7 reduces the resulting 
error in this example. 

Using the Laplacian as described, with £(u) = u xx (in this one-dimensional .j} 
r example), also results in error-free compressions of (VjVwj, (Vw| and u. ij"? 



;^ 10 In apparatus implementations of the present invention, each of the steps or 

operations involved can be carried out by executing one or more program oriogicrpo|^ 





jfc0$:£ 4 \ , The terrain, signal or surface data can, as discussed above, be simulated or real^rid^p 
empirically gathered) data. - 'V - : *#*5 

A processor-based system according to the invention can thus be connected to 
15 input or receiving devices (including sensors, satellite receivers, etc.) 2 10 and I/O channels 
200 as shown in Figure 1, and the I/O channels may communicate with other apparatus 
that use the processed surface and gradient signals, such as avionics (not separately 
shown) or other user interface equipment. 
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